home *** CD-ROM | disk | FTP | other *** search
/ Chip: 2005 Utilities / CHIP Utilities 2005.7z / CHIP Utilities 2005.iso / docs / datalife / support.wdc.com / robots.txt
Text File  |  2003-06-10  |  389b  |  22 lines
  1. # robots.txt
  2. User-agent: HomepageSearchEngine
  3. Disallow: /bp/
  4. Disallow: /cn/
  5. Disallow: /de/
  6. Disallow: /fr/
  7. Disallow: /kr/
  8. Disallow: /ls/
  9. Disallow: /ru/
  10. Disallow: /aspnet_client
  11. Disallow: /includes
  12. Disallow: /logs
  13. Disallow: /wdscripts
  14. Disallow: /wdstyle
  15.  
  16. User-agent: *
  17. Disallow: /aspnet_client
  18. Disallow: /includes
  19. Disallow: /logs
  20. Disallow: /wdscripts
  21. Disallow: /wdstyle
  22.